Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance tests #1301

Merged
merged 20 commits into from
Jul 11, 2023
Merged

Performance tests #1301

merged 20 commits into from
Jul 11, 2023

Conversation

michaelkaye
Copy link
Contributor

We seek to split out the performance tests into:

  • launch time
  • login time
  • (first) sync time
  • room join time

At present I'm comfortable with the timings for launch, login and first sync, but room join seems to have a 20s delay that I'm not expecting.

This is now running fairly stability on the GHA runner so if/when we merge we should let it run for a week or so to gather information on reliability of the tests.

Before merging, I would like to delete the test that just check application launch time - we can pull that metric from the main test. I tried to do so already but there was a complaint about missing files in the build, so this may be something to do with generated project configurations I'm not sure about.

@github-actions
Copy link

github-actions bot commented Jul 10, 2023

Warnings
⚠️ Please add a changelog.
⚠️ Some of the commits are missing ticket numbers. Please consider squashing all commits that don't have a tracking number.
⚠️ Please add a sign-off to either the PR description or to the commits themselves.
⚠️ You seem to have made changes to views. Please consider adding screenshots.

Generated by 🚫 Danger Swift against 7fd7816

@codecov
Copy link

codecov bot commented Jul 10, 2023

Codecov Report

Patch coverage: 21.73% and project coverage change: -0.10 ⚠️

Comparison is base (5ae2271) 40.16% compared to head (74fbb12) 40.06%.

❗ Current head 74fbb12 differs from pull request most recent head 7fd7816. Consider uploading reports for the commit 7fd7816 to get more accurate results

Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #1301      +/-   ##
===========================================
- Coverage    40.16%   40.06%   -0.10%     
===========================================
  Files          434      435       +1     
  Lines        27676    27751      +75     
  Branches     14204    14232      +28     
===========================================
+ Hits         11115    11118       +3     
- Misses       16264    16335      +71     
- Partials       297      298       +1     
Flag Coverage Δ
unittests 23.19% <21.73%> (-0.05%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
ElementX/Sources/Application/AppCoordinator.swift 46.79% <0.00%> (-0.24%) ⬇️
.../FlowCoordinators/UserSessionFlowCoordinator.swift 26.23% <0.00%> (-0.82%) ⬇️
...mentX/Sources/Other/AccessibilityIdentifiers.swift 31.25% <0.00%> (-3.18%) ⬇️
...rces/Other/SwiftUI/Animation/ShimmerModifier.swift 75.00% <ø> (ø)
...ens/Authentication/AuthenticationCoordinator.swift 60.00% <0.00%> (-0.31%) ⬇️
...ntication/LoginScreen/LoginScreenCoordinator.swift 75.22% <0.00%> (-2.06%) ⬇️
...ces/Screens/HomeScreen/HomeScreenCoordinator.swift 80.43% <0.00%> (-1.79%) ⬇️
...X/Sources/Screens/HomeScreen/View/HomeScreen.swift 34.89% <0.00%> (-0.19%) ⬇️
...s/Screens/HomeScreen/View/HomeScreenRoomCell.swift 70.73% <0.00%> (-0.44%) ⬇️
...ces/Screens/InvitesScreen/View/InvitesScreen.swift 28.57% <0.00%> (-5.86%) ⬇️
... and 10 more

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

fastlane/Fastfile Show resolved Hide resolved
IntegrationTests/Sources/LoginTests.swift Outdated Show resolved Hide resolved
@michaelkaye michaelkaye marked this pull request as ready for review July 10, 2023 15:39
@michaelkaye michaelkaye requested a review from a team as a code owner July 10, 2023 15:39
@michaelkaye michaelkaye requested review from Velin92 and removed request for a team July 10, 2023 15:39
@pixlwave pixlwave enabled auto-merge (squash) July 11, 2023 08:35
@sonarcloud
Copy link

sonarcloud bot commented Jul 11, 2023

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@pixlwave pixlwave disabled auto-merge July 11, 2023 09:32
@pixlwave pixlwave merged commit 5e97a4a into develop Jul 11, 2023
3 checks passed
@pixlwave pixlwave deleted the doug/performance-tests branch July 11, 2023 09:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants